Skip to content

ci(actions): add descriptive names to e2e jobs#16065

Merged
Automaat merged 12 commits intokumahq:masterfrom
Automaat:worktree-ci-jobs
Apr 9, 2026
Merged

ci(actions): add descriptive names to e2e jobs#16065
Automaat merged 12 commits intokumahq:masterfrom
Automaat:worktree-ci-jobs

Conversation

@Automaat
Copy link
Copy Markdown
Contributor

@Automaat Automaat commented Mar 30, 2026 •
edited
Loading

Motivation

E2E CI jobs all show as `e2e (0)`, `e2e (1)` etc. making it impossible to identify which job failed without clicking into each one.

Implementation information

Refactored E2E CI execution:

  • Removed `_e2e.yaml` reusable workflow
  • Extracted E2E execution into a new composite action `.github/actions/run-e2e/action.yml`
  • Moved E2E job definitions into `_test.yaml` with descriptive `name` fields using matrix parameters

Job names now include target, k8s version, arch, and optionally CNI plugin (when non-flannel) and sidecar flag:

  • `e2e (default, v1.34.1-k3s1, amd64) / 0`
  • `e2e (kubernetes, kind, amd64) / 0`
  • `e2e (multizone, v1.34.1-k3s1, amd64, calico) / 0`
  • `e2e (kubernetes, v1.34.1-k3s1, amd64, sidecar) / 0`

Changelog: skip

@Automaat
ci(actions): add descriptive names to e2e jobs
cb0404a 
Signed-off-by: Marcin Skalski <skalskimarcin33@gmail.com>
@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Mar 30, 2026

Reviewer Checklist

🔍 Each of these sections need to be checked by the reviewer of the PR 🔍:
If something doesn't apply please check the box and add a justification if the reason is non obvious.

  • Is the PR title satisfactory? Is this part of a larger feature and should be grouped using > Changelog?
  • PR description is clear and complete. It Links to relevant issue as well as docs and UI issues
  • This will not break child repos: it doesn't hardcode values (.e.g "kumahq" as an image registry)
  • IPv6 is taken into account (.e.g: no string concatenation of host port)
  • Tests (Unit test, E2E tests, manual test on universal and k8s)
    • Don't forget ci/ labels to run additional/fewer tests
  • Does this contain a change that needs to be notified to users? In this case, UPGRADE.md should be updated.
  • Does it need to be backported according to the backporting policy? (this GH action will add "backport" label based on these file globs, if you want to prevent it from adding the "backport" label use no-backport-autolabel label)

Automaat added 7 commits March 30, 2026 21:46
@Automaat
ci(actions): fix descriptive names for e2e jobs
b9550ce 
Signed-off-by: Marcin Skalski <skalskimarcin33@gmail.com>
@Automaat
ci(actions): use caller matrix for e2e job names
29f1e45 
Signed-off-by: Marcin Skalski <skalskimarcin33@gmail.com>
@Automaat
ci(actions): refactor e2e to composite action
ffee7b5 
Signed-off-by: Marcin Skalski <skalskimarcin33@gmail.com>
@Automaat
ci(ci): move runner context to step-level env
4d9d7ae 
Signed-off-by: Marcin Skalski <skalskimarcin33@gmail.com>
@Automaat
ci(actions): fix e2e matrix job names
16cbea7 
- Use empty target array instead of false so
  skipped test_e2e produces 0 matrix combos
- Remove parallelism from matrix after expanding
  to parallelRunnerId
- Add type guard for jq expansion

Signed-off-by: Marcin Skalski <skalskimarcin33@gmail.com>
@Automaat
ci(actions): replace / separator in job names
a278dc4 
GitHub UI interprets / as hierarchy separator,
causing only the trailing "0" to show in sidebar.
Use # instead.

Signed-off-by: Marcin Skalski <skalskimarcin33@gmail.com>
@Automaat
ci(actions): drop parallelRunnerId from names
746791e 
Signed-off-by: Marcin Skalski <skalskimarcin33@gmail.com>
@Automaat Automaat added the ci/run-full-matrix PR: Runs all possible e2e test combination (expensive use carefully) label Apr 2, 2026
@Automaat
ci(actions): trigger build
71588e3 
Signed-off-by: Marcin Skalski <skalskimarcin33@gmail.com>
@Automaat
Copy link
Copy Markdown
Contributor Author

Automaat commented Apr 2, 2026 •
edited
Loading

Actual change

Previously

Screenshot 2026-04-02 at 19 55 56

Now

Screenshot 2026-04-02 at 19 53 34

Automaat and others added 2 commits April 7, 2026 11:51
@Automaat
ci(actions): harden e2e composite action
e0002fc 
- Revert OVERRIDE to .test_e2e = false
- Add // 1 fallback to jq range()
- Move inputs to env vars in shell
- Document DOCKERHUB_PULL_CREDENTIAL dep

Signed-off-by: Marcin Skalski <skalskimarcin33@gmail.com>
@Automaat
Merge branch 'master' into worktree-ci-jobs
947d09c
@Automaat Automaat mentioned this pull request Apr 7, 2026
Closed
@Automaat Automaat marked this pull request as ready for review April 8, 2026 10:13
@Automaat Automaat requested a review from a team as a code owner April 8, 2026 10:13
Copilot AI reviewed Apr 8, 2026
View reviewed changes
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR improves GitHub Actions E2E job readability by generating more descriptive matrix job names and refactoring E2E execution into a composite action, making it easier to identify failing configurations at a glance.

Changes:

  • Expands the generated E2E matrix to include parallelRunnerId values derived from each suite’s parallelism.
  • Adds descriptive name: fields to the E2E matrix jobs to include key configuration attributes.
  • Replaces the reusable workflow _e2e.yaml with a new composite action (.github/actions/run-e2e) and inlines the job steps in _test.yaml.

Reviewed changes

Copilot reviewed 3 out of 3 changed files in this pull request and generated 2 comments.

File Description
.github/workflows/_test.yaml Generates expanded E2E matrices and defines named E2E matrix jobs that call the new composite action.
.github/workflows/_e2e.yaml Removed; prior reusable E2E workflow is replaced by inlined job steps + composite action.
.github/actions/run-e2e/action.yml New composite action encapsulating the E2E build/run flow and artifact upload behavior.

@Automaat Automaat merged commit 94d7cea into kumahq:master Apr 9, 2026
32 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

Copilot code review Copilot Copilot left review comments

@bartsmykla bartsmykla bartsmykla approved these changes

@lobkovilya lobkovilya Awaiting requested review from lobkovilya lobkovilya is a code owner automatically assigned from kumahq/kuma-maintainers

@lukidzi lukidzi Awaiting requested review from lukidzi lukidzi is a code owner automatically assigned from kumahq/kuma-maintainers

Assignees

No one assigned

Labels

ci/run-full-matrix PR: Runs all possible e2e test combination (expensive use carefully)

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@Automaat @bartsmykla